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WTiaf w claimed is: 




CLAIMS 

A 

1 • A method for ^providing force feedback to users interacting with a graphical user 
interface environment of a computer system, the method comprising steps of : . 

5 receiving an indicationW movement of a physical object that is manipulated by a user, said 

physical object being included^n a human interface device that outputs said indication to said 
computer system; 

moving a user-controlled graphical object within a graphical user interface based on said 
indication of said movement of said physical object, wherein said user-controlled graphical object 
10 and said graphical user interface areVlisplayed on a display screen connected to said computer 
system, and wherein said graphical user interface allows said user to interface with operating 
system functions implemented by said computer system; 

outputting an signal from said computer system to said interface device to command said 
interface device to apply a force sensation to said physical object, wherein said force is associated 
15 with at least one of said operating system functions of said graphical user interface. 



2 . A method as recited in claim 1 wherein said user-controlled graphical object is a cursor. 

3. A method as recited in claim 2 wherein said force sensation applied to said physical 
object is determined, at least in part, by a location of s&d cursor in said graphical user interface 
with respect to targets located in said graphical user mterffice. 

20 4. A method as recited in claim 2 wherei^s^<fe£p^sensation applied to said physical 

object is determined, at least in part, by a velocity of saia cursor moving within said graphical user 
interface. 

5. A method as recited in claim 2 wherein said f^rce sensation applied to said physical 
object is determined, at least in part, by an acceleration of safd cursor moving within said graphical 
25 user interface. \ 

(§) A method as recited in claim 2 wherein said force\ensation applied to said physical 
object is determined, at least in part, by a history of previous locations of said cursor within said 
graphical user interface with respect to targets located in said grap^cal user interface. 




7. A method as reched in claim 3 wherein said force sensation on said physical object 
assists said user to select saia^at least one operating system function associated with said force 
sensation. 

8 A method as recited in\claim 3 wherein said force sensation on said physical object 
5 informs said user of other graphical\)bjects in said GUI which can be manipulated to perform said 
at least one operating system function 

9. A method as recited in claVn 7 further comprising a step of performing one of said 
operating system functions as indicates by said location of said cursor and as indicated by a 
command from said user, wherein said force sensation applied to said physical object assists said 

10 user in selecting said operating system function. 

10. A method as recited in claim 9 wherein said performed operating system function is 
associated with a particular type of target of sard graphical user interface. 

1 1. A method as recited in claim 9 wherein a magnitude of said force sensation applied to 
said physical object depends on a particular targe\ of said graphical user interface into which said 

15 cursor is moved. 

12. A method as recited in claim 9 wherein V typeof said force sensation applied to said 
physical object depends on a particular target of said gmphicaLuser interface into which said cursor 
is moved. A 1/ \ 

13. A method as recited in claim 9 whereinsaid target region includes an icon, and 
20 wherein said command from said user includes selecting a Button on the interface device. 

14. A method as recited in claim 13 wherein said\pperating system function includes 
executing a program that is independent from said operating system, said program being associated 
with said icon selected by said cursor. 

15. A method as recited in claim 13 wherein said force\sensation is an attractive force 
25 between said icon and said cursor, said attractive force being applied to said user object when said 

cursor is within a predetermined distance of said icon to assist said user in selecting said icon. 

16. A method as recited in claim 3 wherein said force sensation is an obstructive force 
positioned at a boundary of a target to prevent said user from easily moving said cursor out of said 
target. ^ 
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17. A method afe recited in claim 7 wherein said force sensation is an inertia force applied 
to said physical object when a target region is moved by said cursor in said graphical user 
interface. 

18. A method as rented in claim 17 wherein said inertial force is a damping force that 
5 damps movement of said use^[ object according to a damping constant and the velocity of said 

cursor. 



10 



19. A method as recited ib claim 1 wherein said force sensation is a damping force applied 
to said physical object as said cursor is moved on said display screen. 

20. A method as recited in cmim 1 wherein said physical object is a joystick handle. 

21. A method as recited in claim 1 wherein said physical object and said interface device 
are included in a mouse. 



22. A method as recited in claim 1 wherein said force sensation is applied to said physical 
object by an electrically controlled actuator of said interface device. 

23. A method as recited in claim 2 whWein said signal output to said interface device is a 
15 high level host command sent to microprocessor* local to said interface device and separate from 

said computer system,. 

24. A method as recited in claim 23 furtheV comprising a step of providing layout data to 
said microprocessor, said layout data indicating a^ati/il lavout of targets in said GUI such that 
said microprocessor can check said spatial layouttg)^feanin€when force sensations associated 

20 with said targets may be applied to said user object. 



25. A including program instructions for performing steps for a process of providing 
force feedback to the user of a graphical user interface displayed by a computer system, the steps 
comprising: \ 

determining a location of a user-controlled cursor Wthin a graphical user interface 
displayed on a display screen of a computer system, said cursor being controlled by said user by 
manipulating a physical object of an interface device; \ 

determining which targets displayed within said graphical tiser interface are associated with 
target forces that affect said physical object based on said locadoi\pf said user-controlled cursor, 
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wherein said targets allo^v said user to interface with operating system functions implemented by 
said graphical user interface; 

providing a signal to apply a resulting force to said physical object based on said forces 
associated with said targets which affect forces on said physical object. 



26. A computer readable medium as recited in claim 25 wherein each of said targets are 
associated with at least two different target force sensations depending on said location of said 
cursor with respect to each of said targets. 

27. A computer readable medium as recited in claim 26 wherein a position control 
paradigm is implemented such that Said location of said cursor in said graphical user interface 
approximately corresponds to a locati&n of said physical object with reference to an origin of said 
interface device. 

28. A computer readable medium as recited in claim 27 wherein said two different target* 
force sensations include an internal target force sensation and an external target force sensation, 
wherein said internal target force sensatioAis applied to said physical object when said cursor is 
located within said target, and said external 7 ftifeet foece sensation is applied to said physical object 
when said cursor is located outside said target 

29. A computer readable medium as rebited in claim 28 wherein said internal target force 
sensation includes a capture force sensation when said cursor is located near a boundary of said 
target, and wherein said internal target force sensation includes a dead region force sensation when 
said cursor is located near a center of said target. 

30. A computer readable medium as recited in claim 28 wherein said targets of said GUI 
are ordered in a hierarchy, and wherein said step of determining which targets may affect force 
sensations on said physical object includes deterrnininfe a cursor target of lowest hierarchy in which 
said cursor is located. 

31. A computer readable medium. as recited in\ claim 30 wherein an internal target force 
sensation associated with said cursor target affects said physical object and wherein no other 
internal force sensations of other targets affect said physical object. 

32. A computer readable medium as recited L claim 31 wherein other targets at a 
hierarchical level lower than said cursor target have external force sensations that affect said 
physical object, wherein said cursor is not located in said diher targets. 
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33. A compuW readable medium as recited in claim 32 wherein said resulting force 
sensation applied to ^ald physical object is a sum of said internal target force .sensation of said 
cursor target and said external target force sensations of said other targets at said hierarchy lower 
than said lowest hierarchical level. 

5 34. A computer readable medium as recited in claim 33 wherein said other targets are 

included within said cursor target and are at a lower hierarchical level than said cursor target. 

35. A computer readable medium as recited in claim 32 wherein when said cursor is 
located in at least two of said cursor targets, only the target displayed on top of said other targets of 
said at least two targets is selected as said cursor target. 

10 36. A computer readable medium as recited in claim 25 further comprising a step of 

| mapping force sensations to targere provided by said graphical user interface. 

* \ ■ - 

i \ 

j 37. A computer readable m&dium as recited in claim 36 wherein said step of mapping force 

1 sensations includes assigning ranged to said targets, said ranges defining external regions around 

I said targets which affect said external force sensation on physical object when said cursor is 

\ 15 located within said external regions. 

j 

1 38. A computer readable medium as recited in claim 37 wherein said ranges are assigned a 

j shape. 

i 

39. A computer readable medium aa recited in claim 38 wherein said step of mapping force 
sensations includes mapping internal and extarnal target force sensations to said targets. 
1 f \ /\ 

20 40. A computer readable medium Asr recited in claim 29 wherein said capture force 

sensation includes a snap-over force saj^tW^aid snap-over force sensation providing a 
resistance to said movement of said cursor whei^said cursor from within said target to outside said 
target. 

41. A computer readable medium as recited in claim 29 wherein said external target force 
25 sensation includes a force field, said force field providing an attractive force sensation to said 

physical object to draw said cursor toward said target. 

42. A computer readable medium as recited ih claim 29 wherein said external target force* 
sensation includes a force field, said force field providing a repulsive force sensation to said 
physical object to push said cursor away from said target. 
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43. A computer readable medium as recited in claim 29 wherein said external target force 
sensation includes twdintersecting groove force sensations, said groove force sensations biasing 
said cursor to move toward said target and locking said cursor on said target. 

44. A computer Veadable medium as recited in claim 43 further comprising a step of 
5 removing said groove for<& sensations after said cursor is locked on said target when said target is 

selected by said user, 

45. A computer readable medium as recited in claim 36 wherein said target is an icon. 

46. A computer readable medium as recited in claim 36 wherein said target is a button. 

47. A computer readable medium as recited in claim 36 wherein said target is a slider. 

10 48. A computer readable medium as recited in claim 47 wherein said slider includes a 

thumb movable on a guide, and wherein an attractive force attracts said cursor to said thumb. 

49. A computer readable medium as recited in claim 36 wherein said target is a menu item 
on a pull-down menu. 



50. A computer readable medium as recited in claim 36 wherein said target is a window. 



51. A computer system for providing force feedback to a user of a graphical user interface 
displayed by said computer system, comprising: 

means for determining a location\6t a user-controlled cursor within a graphical user 
interface displayed on a display screen of-acbfflpmer system, said cursor being controlled by said 
20 user by manipulating a physical object of an^interface device, and wherein targets are provided in 
said graphical user interface which are associated with operating system functions implemented by 
said graphical user interface, said cursor being movable to select said targets to select said 
associated operating system function; \ 

means for determining which targets displayed within, said graphical user interface are 
25 associated with target forces affecting said physical object based on said location of said user- 
controlled cursor; \ 

means for providing a signal to apply a resulting force sensation to said physical object 
based on said forces associated with said targets whicl^affect forces on said physical object: 
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52. A computer system as recited in claim 51 wherein said means for determining said 
targets includes means for determining a cursor target of lowest hierarchy in which said cursor is 
located. 

53. A computer system Ws recited in claim 52 wherein said cursor target is a menu item in a 
pull-down menu. 

54. A computer system as recited in claim 53 wherein said menu item is associated with a 
snap-over force at a boundary of said menu item, said snap-over force providing a obstructive 
force to said movement of said cursor when said cursor is moved from one menu item to another 
menu item. 

55. A computer system as recited in claim 53 wherein said menu item is associated with a 
snap-to force at a center area of said menu item, said shap-to force providing an attractive force that 
keeps said cursor at said center arealof said menu item. 

56. A computer system as recited in claim 52 wherein said cursor target is a slider having a 
thumb that can be moved within a linear guide. 

57. A computer system as recpted in claim 56 wherein said slider is associated with a snap- 
to force provided at a middle line along a length and halfway across a width of said guide of said 
slider, said snap-to force providing aq attractive force that keeps said cursor at said middle line of 
said guide. 
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58. A computer system as recite 



52 wherein said cursor target is an icon. 



59. A computer system as (ecttefl in' claim 56 'wherein said icon is associated with an 
attractive force associated with a surrounding region having a predetermined size, said attractive 



force pulling said physical object and sai 



60. A computer system as recit 
capture force associated with a boundary 
force to said physical object when said cufsor 



61. A computer system as recited 
region force associated with an internal 
predetermined damping force to said phykical 
region. 



62. A computer system as recited 



cursor when said cursor is moved within said region. 



d in claim 59 wherein said icon is associated with an 
of said icon, said capture force providing an obstructive 
is moved out of said icon. 



in claim 59 wherein said icon is associated with a dead 
ijegion of said icon, said dead region force providing a 
object when said cursor is moved in said internal 



i a claim 52 wherein said target is a graphical button. 
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63. A system for providing force feedback to a user manipulating an interface device, the 
system comprising: 

a host computer systeih for receiving an input control signal describing a location of a user 
5 manipulable object in a degreeW freedom and for providing a host output control signal, wherein 
said host computer system updates the location of a user-controlled cursor within a graphical user 
interface displayed on a display screen of said host computer system, said cursor being updated 
based on said input control signal; 

a processor local to said interface device and separate from said host computer system for 
10 receiving said host output control signal from said host computer system and providing a processor 
output control signal; 

an actuator for receiving said processor output control signal and providing a force along 
said degree of freedom in accordance with said processor output control signal to said user 
manipulable object coupled to said actuator; and 

15 a sensor for detecting motion of said user manipulable object along said degree of freedom 

and outputting said input control signal including information representative of the position and 
motion of said object. 

64. A system as recited in claim\6J wtterein said sensor outputs said input control 
signal to said processor, and wherein said pr^ss^(provid^s said input control signal to said host 

20 computer. 

65. A system as recited in claim 63V wherein said host computer system displays a 
number of targets in said graphical user interface ind determines which targets are associated with 
target forces that affect said physical object based\on said location of said user-controlled cursor, 
wherein said targets allow said user to interface witji operating system functions implemented by 

25 said graphical user interface. 

66. A system as recited in claim 65 whereto said host output control signal commands 
resulting force to said physical object based on said forces associated with said targets which affect 
forces on said physical object. 
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67. A system as recited in claim 66 whereifa said processor is operative in a reflex 
process to provide said processor output control signal toWd actuator in response to said position 
and motion of said object independently of said host output control signal. 
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68. A system as recited in claim 67 wherein said host output signal is a high level 
command from said host computer system, and wherein said processor implements one of a 
plurality of local processes s&Lected in accordance with said high level command to implement said 
reflex process. 

69. A system as recited in claim 65 wherein said user manipulable object can be moved 
by said user in a plurality of degrees of freedom, and wherein said system further comprises an 
actuator for providing a force along a degree of freedom of said object, and a sensor for detecting 
motion of said object in said degree of freedom for each of said plurality of degrees of freedom. 

70. A system as recited m claim 65 further comprising a serial interface for outputting 
said host output control signal from aaid host computer system and for receiving said input control 
signal to said host computer system. 



71. 

Serial Bus. 



A system as recited in claim 70 wherein said serial interface includes a Universal 



72. A system as recited inl claim 65 further comprising a clock coupled to said 
15 processor, wherein said processor accesses said clock to determine, in part, said force provided by 
said actuator. 
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73. A system as recited in claim 65 further comprising a memory device accessible by 
said local processor, wherein said local processor stores a spatial representation of said targets in 
said memory device such that said processor may detect when said target forces affect said physical 
object. 

74. A system as recited in 
memory storage for storing predete 




erein said memory device includes a permanent 
; associated with said targets. 



75. A method for providing force feedback for graphical objects in a game implemented on 
a computer system, the method comprising the steps of: 



displaying a user-controlled first graphical object on a display screen of a computer system, 
said graphical object moving on said display screen during a game in response to manipulations of 
a physical object of an interface device by a user, said interface device being coupled to said 
computer system; 

displaying a second graphical object on said display screen; 
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when said first graphical object collides with said second graphical object on said screen: 

a) displaying a compression of said first object where said second object contacts 
said first object, wherein said first object has a predetermined simulated compliance and said 
second object has a predetermined simulated mass; 

b) outputting a force command to said interface device to apply a force to said 
physical object manipulated by \aid user in at least one degree of freedom provided by said 
interface device, said force beings applied in the direction of said compression and having a 
magnitude in accordance with said smiulated masses of said first and second graphical objects. 

76. A method as recited in claim 75 wherein said force has a magnitude also in accordance 
with a simulated compliance of said first\graphical object. 

77. A method as recited in claim 76 wherein said force has a magnitude also in accordance 
with simulated velocities of said first graphical object and said second graphical object. 

78. A method as recited in claim 76 v^herein said force has a magnitude also in accordance 
with a simulated gravity acting on said objects J 

79. A method as recited in claim 76 wheWn said first graphical object is a linear segment, 
and wherein said second graphical object is a circular object. 

80. A method as recited in claim 76 whereih said second graphical object moves on said 
display screen during a game in response to manipulationg^f a second physical object of an second 
interface device by a second user, said second interface device being coupled to said computer 
system. 

81. A method as recited in claim 80 wherein saiduirst and second interface devices input 
sensor signals indicating motion of said first physical object and said second physical object, 
respectively, wherein said user is a first user and said force dpmmand to said first interface device 
is based on sensor signals output from said second interface davice, and wherein a force command 
output to said second interface device is based on sensor signals output from said first interface 
device. 

82. A method as recited in claim 76 wherein said second graphical object moves on said 
display screen during a game in response to manipulations of a second physical object of an second 
interface device by a second user, said second interface device being dpupied to a second computer 
system coupled to said computer system through a network interface. 
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83. A method as recited in claim 76 further comprising a step of changing said simulated 
compliance of said first graphical object when an input command is received from said user 
operating an input device on said interface device. 

84. A method as recited in c\aim 76 further comprising displaying a goal object on said 
display screen and wherein said useV moves said first graphical object to block said second 
graphical object from moving into said gpal object. 

85. A method as recited in claim 79 further comprising changing a displayed orientation of 
said linear segment according to input data Weiyed from said user operating said input device. 



10 



86. A method as recited in claim 
wherein said input data received from said 
degree of freedom. 



user 



d physical object is a joystick handle, and 
includes a spin of said joystick handle in a rotary 



87, A method as recited in claim 86 wherein said interface device provides two linear 
degrees of freedom to said joystick handle in addition to said rotary degree of freedom. 




